"Can you hear me now?": a qualitative exploration of communication quality in virtual primary care encounters for patients with intellectual and developmental disabilities.

BACKGROUND: High quality communication is central to effective primary care. The COVID-19 pandemic led to a dramatic increase in virtual care but little is known about how this may affect communication quality. Adults with intellectual and developmental disabilities (IDD) can experience challenges communicating or communicate in non-traditional ways. This study explored how the use of virtual modalities, including telephone and video, affects communication in primary care interactions for patients with IDD. METHODS: This qualitative descriptive study included semi-structured interviews with a multi-stakeholder sample of 38 participants, including 11 adults with IDD, 13 family caregivers, 5 IDD support staff and 9 primary care physicians. Interviews were conducted in Ontario, Canada between March and November 2021 by video-conference or telephone. A mixed inductive and deductive thematic analysis approach was used to code the data and identify themes. Themes were reviewed and refined with members of each stakeholder group. RESULTS: Four elements of communication were identified that were affected by virtual care: (1) patient engagement in the virtual appointment; (2) the ability to hear other participants and have the time and space to be heard; (3) the ability to use nonverbal communication strategies; and (4) the ability to form trusting relationships. In some cases, the virtual platform hindered these elements of communication. Video offered some advantages over telephone to support nonverbal communication, and stimulate engagement; though this could be limited by technical challenges. For adults with IDD who find it difficult to attend in-person appointments, virtual care improved communication quality by allowing them to participate from a space where they were comfortable. CONCLUSION: Though there are circumstances in which virtual delivery can improve communication for patients with IDD, there are also challenges to achieving high quality patient-provider communication over telephone and video. Improved infrastructure and training for providers, patients and caregivers can help improve communication quality, though in some cases it may never be appropriate. A flexible patient-centred approach is needed that includes in-person, telephone and video options for care.

Building effective public dental care programs: The critical role of implementation evaluation.

There are significant income-related inequities in oral health and access to oral health care. Public dental programs generally aim to increase access to oral health care for individuals with financial barriers through government payments for appointments. Low engagement from both oral health care providers and intended patients are common challenges in delivery of public dental programs, and are impediments to program impact and outcomes. Still, these programs rarely address the systemic issues that affect the experiences of intended users. This accentuates the importance of monitoring of program delivery to refine or adapt programs to better meet needs of service providers and users. As such, specifying program goals and developing a related monitoring strategy are critical as Canada begins to implement a national public dental program. Drawing on an example of a pediatric public dental program for children from low-income families or with severe disabilities in Ontario, Canada, this article illustrates how an implementation and evaluation framework could be applied to measure implementation and impact of the national program. The RE-AIM framework measures performance across five domains: (1) Reach, (2) Effectiveness (patient level), (3) Adoption, (4) Implementation (provider, setting, and policy levels), and (5) Maintenance (all levels). Given the disparities in oral disease and access to oral health care, the results can be used most effectively to adapt programs if relevant stakeholders participate in reviewing data, investigating quality gaps, and developing improvement strategies.

Accessibility of Virtual Primary Care for Adults With Intellectual and Developmental Disabilities During the COVID-19 Pandemic: Qualitative Study.

BACKGROUND: The COVID-19 pandemic has led to an unprecedented increase in the delivery of virtual primary care. Adults with intellectual and developmental disabilities (IDDs) have complex health care needs, and little is known about the value and appropriateness of virtual care for this patient population. OBJECTIVE: The aim of this study was to explore the accessibility of virtual primary care for patients with IDDs during the pandemic. METHODS: We conducted semistructured interviews with 38 participants in Ontario, Canada between March and November 2021. A maximum variation sampling strategy was used to achieve a diverse sample including 11 adults with IDDs, 13 family caregivers, 5 IDD support staff members, and 9 primary care physicians. An iterative mixed inductive and deductive thematic analysis approach was used to code the data and synthesize higher-level themes. The analysis was informed by the Levesque Patient-Centered Access to Health Care Framework. RESULTS: We identified themes related to 4 of 5 access-to-care dimensions that highlighted both the benefits and challenges of virtual care for adults with IDDs. The benefits included saving time spent traveling and waiting; avoiding anxiety and challenging behavior for patients who struggle to attend in-person visits; allowing caregivers who live far away from their loved ones to participate; reducing illness transmission; and allowing health care providers to see patients in their home environments. The challenges included lack of access to necessary technology, lack of comfort or skill using technology, and lack of nonverbal communication; difficulty engaging and establishing rapport; patient exclusion from the health care encounter; and concerns about privacy and confidentiality. An overarching theme was that "one size does not fit all," and the accessibility of virtual care was dependent on the interaction between the following 5 categories of factors: patient characteristics, patient context, caregiver characteristics, service context, and reason for a particular primary care visit. Though virtual care was not always appropriate, in some cases, it dramatically improved patients' abilities to access necessary health care. CONCLUSIONS: This study suggests that a flexible patient-centered system including multiple delivery modalities is needed to ensure all patients have access to primary care. Implementing this system will require improved virtual care platforms, access to technology for patients and caregivers, training for primary care providers, and appropriately aligned primary care funding models.

The Working Alliance as a Mediator Between Fidelity to Strengths Model Case Management and Client Outcomes.

Objective: The purpose of this study was to examine how the client­case manager working alliance in strengths model case management (SMCM) mediates the relationship between fidelity to the SMCM intervention and clients' quality of life, hope, and community functioning. Methods: In total, 311 people with severe mental illness, served at seven community mental health agencies in Canada, participated in the study. They were new to SMCM and participated in five structured interviews every 4.5 months for 18 months to measure the quality of the client­case manager working alliance and clients' quality of life, hope, and community functioning. The team-level SMCM fidelity scale was administered six times over 3 years. Ordinary least-squares path analysis was used to test simple mediation models. Results: Higher fidelity to SMCM was associated with better client outcomes indirectly through the working alliance. Higher SMCM fidelity predicted a stronger working alliance, which in turn predicted greater improvements in client quality of life (at 9 months and 18 months), hope (at 18 months), and community functioning (at 9 months). Conclusions: The results support the view that SMCM is an effective intervention. When the intervention was implemented as planned, it fostered stronger working alliances between clients and case managers and contributed to greater improvements in the quality of life, hope, and functioning of people with severe mental illness. The findings of this study highlight the value of ongoing monitoring of implementation fidelity to achieve high-fidelity interventions that may lead to positive client outcomes.

Implementation of strengths model case management in seven mental health agencies in Canada: Direct-service practitioners' implementation experience.

RATIONALE: Implementation of strengths model case management is increasing internationally. However, few studies have focused on its implementation process, and none have specifically addressed the implementation experience of direct-service practitioners. OBJECTIVE: This paper presents factors that facilitate and impede the successful implementation of the strengths model, with a specific focus on practitioners who deliver the intervention directly to service recipients. METHOD: To address this objective, a qualitative study of seven mental health agencies that implemented the model was conducted, involving a combination of participant observations and qualitative semistructured interviews with case managers, team supervisors, and senior managers. Qualitative data were analyzed using open coding followed by axial coding. Finally, the findings were aligned with an adapted Consolidated Framework for Implementation Research. RESULTS: Implementation of the strengths model involved a significant change in practice for case management practitioners. The results confirm that at the beginning of implementation, the strengths model was perceived as complex and not always adaptable to on-the-ground realities. With time, and with support from management, ongoing training and supervision sessions, and reflection and discussion, practitioners regained feelings of competence and resistance to the model diminished. The use of the model's structured team-based supervision tools was fundamental to supporting the implementation process by enabling an interactive and concrete training approach. CONCLUSIONS: The more an approach leads to changes in daily practice and is perceived as complex, the more concrete support is needed during implementation. This article highlights the importance of attending to a practitioner's sense of personal effectiveness and competence in the adoption of new practices.

Association between fidelity to the strengths model of case management and client outcomes: A quasi-experimental study.

OBJECTIVE: Evidence concerning strengths model of case management (SMCM) remains mixed. This study aimed to test the hypotheses that higher fidelity to SMCM is associated with improved quality of life (QoL), hope, community participation, community functioning, more days of competitive employment and of independent living, and fewer days of hospitalization. METHODS: SMCM was implemented over a 3-year period, at seven sites in the Canadian provinces of Newfoundland and Labrador, Québec, and Ontario. Independent assessors visited 14 teams at the seven sites to evaluate fidelity at baseline and 6, 12, 18, 24, and 36 months later. Participants (N = 311) answered standardized questionnaires at 4.5-month intervals up to 18 months. Fidelity assessments were interpolated so they could be associated with questionnaire responses. Linear mixed-effects models and generalized linear models were estimated. RESULTS: Fidelity increased significantly, with all sites except one achieving or approaching good fidelity within 36 months. Fidelity was not significantly associated with any of the outcome measures, although all estimated directions of relationships were consistent with our hypotheses. CONCLUSIONS AND IMPLICATIONS FOR PRACTICE: In a pragmatic study of real-world implementation of the strengths model at seven sites, no statistically significant relationships between fidelity and outcomes were found. Low variation in fidelity across individuals, modest sample size, and limited ability to detect change over 18 months, may have contributed to these null findings. (PsycInfo Database Record (c) 2022 APA, all rights reserved).

"This Is about My Health": Partnering with Patients and Families to Share Knowledge and Tools about Healthcare Communication for Adults with Intellectual and Developmental Disabilities.

This project involved patients with intellectual and developmental disabilities and a family caregiver as advisors on a knowledge translation (KT) effort on healthcare communication. The project demonstrated that with the right supports, patient and family advisors can effectively share their experiences and add a powerful voice to KT activities. Lessons learned included the importance of being creative, responsive and flexible to support the advisors, of recognizing their expertise and of building capacity in multiple advisors to allow for diverse voices and greater flexibility. This work requires adequate time and funding, which needs to be factored into planning.

Implementing the Strengths Model of Case Management: Assessing Practice Three Years After Initial Implementation.

While strengths approaches are important to recovery-oriented practice, implementation can be challenging. This study implemented the strengths model of case management (SMCM) in 11 CM teams and assessed the fidelity of delivery and staff perceptions of the model after 36 months using the SMCM fidelity scale and the Readiness Monitoring Tool. Paired sample t-tests assessed change in fidelity from baseline to 36 months. Adjusted regression analyses compared survey responses of direct and management staff. While fidelity ratings significantly improved across all domains, at 36 months they remained suboptimal in supervision practices and use of model tools. Staff perceptions were generally positive but consistently lower for front-line than management staff. Implementing SMCM into existing case management practice with good fidelity is feasible. However, clear support from management may strengthen staff motivation and delivery. A review of practice later in implementation can flag challenges for sustainability and guide implementation support.

Protocol for a Case Control Study to Evaluate Oral Health as a Biomarker of Child Exposure to Adverse Psychosocial Experiences.

BACKGROUND: The early identification of children who have experienced adversity is critical for the timely delivery of interventions to improve coping and reduce negative consequences. Self-report is the usual practice for identifying children with exposure to adversity. However, physiological characteristics that signal the presence of disease or other exposures may provide a more objective identification strategy. This protocol describes a case-control study that assesses whether exposure to adversity is more common in children with tooth enamel anomalies compared to children without such anomalies. METHODS: For 150 mother-child pairs from a pediatric dental clinic in Toronto, Canada, maternal interviews will assess the child's adverse and resilience-building experiences. Per child, one (exfoliated or extracted) tooth will be assessed for suspected enamel anomalies. If anomalies are present, the child is a case, and if absent, the child is a control. Tooth assessment modalities will include usual practice for dental exams (visual assessment) and modalities with greater sensitivity to identify anomalies. CONCLUSION: If structural changes in children's teeth are associated with exposure to adversity, routine dental exams could provide an opportunity to screen children for experiences of adversity. Affected children could be referred for follow-up.

Improving capacity to care for patients with intellectual and developmental disabilities: The value of an experiential learning model for family medicine residents.

BACKGROUND: Patients with intellectual and developmental disabilities (IDD) are more likely to experience poor health outcomes and family physicians receive inadequate training to provide appropriate care to this patient group. Little prior research has studied how to effectively train family physicians to care for patients with IDD. OBJECTIVE: The aim of this pilot study was to assess the value of adding an experiential component to didactic education strategies to improve family medicine resident perceived comfort, skills and knowledge related to caring for patients with IDD. METHODS: Structured education programs for residents were implemented at three primary care practices in Ontario, Canada. Two practices received didactic information only (didactic-only group); one received didactic information and an experiential training model including clinical interactions and a written reflection on that experience (didactic plus experiential group). In this separate-sample pre-post design, residents were invited to complete a brief anonymous survey prior to and following the training assessing their perceived comfort, skills and knowledge related to patients with IDD. RESULTS: At baseline, there were no significant differences between the two groups of residents. At follow up, the experiential group reported significantly higher levels of comfort, skills, and knowledge compared to baseline for most items assessed, while in the didactic-only group most items showed little or no improvement. CONCLUSION: This pilot study suggests that providing residents the opportunity to participate in clinical encounters with patients with IDD, as well as a structured process to reflect on such encounters, results in greater benefit than didactic training alone.

The Nuts and Bolts of Health Care: Evaluating an initiative to build direct support professional capacity to support the health care of individuals with intellectual disabilities.

BACKGROUND: Direct support professionals (DSP) are instrumental in supporting the health care of individuals with intellectual disabilities, yet receive little training and support for this role. We implemented a capacity building intervention for DSPs in a community agency in Ontario, Canada. This study evaluated the perceived value and feasibility of the intervention and the value of a structured implementation approach. METHOD: The intervention included communication tools, a health resource toolkit, and training. A mixed methods evaluation was used to collect feedback from DSPs and people with intellectual disabilities. RESULTS: Participants generally found the intervention valuable and feasible. Although practice change is difficult, extensive engagement and being responsive to feedback were helpful strategies. The primary concern reported by DSPs was resistance from health care providers. CONCLUSION: An important next step is to engage health care providers to ensure the tools are valuable and feasible for everyone involved in the health encounter.

The quick pivot: Capturing real world modifications for the re-implementation of an early psychosis program transitioning to virtual delivery.

Background: Team-based Early Psychosis Intervention (EPI) services is standard of care for youth with psychosis. The COVID-19 pandemic required most EPI services to mount an unplanned, rapid pivot to virtual delivery, with limited guidance on how to deliver virtual clinical services or whether quality of re-implementation and treatment outcomes would be impacted. We used a structured approach to identify essential modifications for the delivery of core components and explored facilitators and barriers for re-implementation and fidelity of a virtually delivered EPI intervention. Materials and methods: NAVIGATE is a structured approach to team-based EPI. It provides detailed modules to guide delivery of core components including medication management, psychoeducation and psychotherapies, supported employment/education, and family education. Having initially implemented NAVIGATE at the Centre for Addiction and Mental Health (CAMH) in 2017, the EPI service transitioned to virtual delivery amid the COVID pandemic. Using a practice profile developed to support implementation, we detailed how core components of NAVIGATE were rapidly modified for virtual delivery as reported in structured group meetings with clinicians. The Framework for Reporting Adaptations and Modifications for Evidence-Based Interventions (FRAME) was used to describe modifications. Fidelity to the EPI standards of care was assessed by the First Episode Psychosis Fidelity Scale (FEPS-FS). Re-implementation barriers and facilitators and subsequent mitigation strategies were explored using structured clinician interviews guided by the Consolidated Framework for Implementation Research (CFIR). Results: Identified modifications related to the intervention process, context, and training. We identified contextual factors affecting the re-implementation of virtually delivered NAVIGATE and then documented mitigating strategies that addressed these barriers. Findings can inform the implementation of virtual EPI services elsewhere, including guidance on processes, training and technology, and approaches to providing care virtually. Discussion: This study identified modifications, impacts and mitigations to barriers emerging from rapid, unplanned virtual delivery of EPI services. These findings can support delivery of high-quality virtual services to youth with psychosis when virtual care is indicated.

Adapting Evidence-Based Early Psychosis Intervention Services for Virtual Delivery: Protocol for a Pragmatic Mixed Methods Implementation and Evaluation Study.

BACKGROUND: Timely and comprehensive treatment in the form of early psychosis intervention (EPI) has become the standard of care for youth with psychosis. While EPI services were designed to be delivered in person, the COVID-19 pandemic required many EPI programs to rapidly transition to virtual delivery, with little evidence to guide intervention adaptations or to support the effectiveness and satisfaction with virtual EPI services. OBJECTIVE: This study aims to explore the adaptations required to deliver NAVIGATE, a model of coordinated specialty care used in EPI, in a virtual format. This study will evaluate implementation of the NAVIGATE model delivered virtually by describing the nature of the adaptations to the intervention, assessing fidelity to the EPI model and the satisfaction of clients, family members, and care providers. We will investigate barriers and facilitators to virtual NAVIGATE implementation, service engagement, and health equity impacts of this work. METHODS: The Centre for Addiction and Mental Health (Toronto, Ontario, Canada) transitioned to delivering NAVIGATE virtually early in the COVID-19 pandemic. The Framework for Reporting Adaptations and Modifications for Evidence-Based Interventions will be used to describe the adaptations required to deliver NAVIGATE virtually. Fidelity to the EPI model will be measured using the First Episode Psychosis Services Fidelity Scale and fidelity to NAVIGATE will be assessed by investigating adherence to its core components. Implementation facilitators and barriers will be explored using semistructured interviews with providers informed by the Consolidated Framework for Implementation Research. Satisfaction with virtually delivered NAVIGATE will be assessed with virtual client and provider experience surveys and qualitative interviews with clients, family members, and providers. Service engagement data will be collected through review of medical records, and potential impacts of virtually delivered NAVIGATE on different population groups will be assessed with the Health Equity Impact Assessment. RESULTS: Virtual clinical delivery of NAVIGATE started in March 2020 with additional adaptations and data collection is ongoing. Data will be analyzed using descriptive statistics and survival analysis for quantitative data. Qualitative data will be analyzed using thematic content analysis. Integration of qualitative and quantitative data will occur at the data collection, interpretation, and reporting levels following a convergent design. CONCLUSIONS: This study will provide information regarding the type of intervention adaptations required for virtual delivery of NAVIGATE for youth with early psychosis, ensuring access to high-quality care for this population during the pandemic and beyond by guiding future implementation in similar contexts. INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID): DERR1-10.2196/34591.

Validation of the Patient Generated Index for people with severe mental illness.

OBJECTIVE: The Patient Generated Index (PGI) is a personalized quality of life (QOL) measure. This secondary analysis examined its psychometric properties with people with severe mental illness. METHODS: Three hundred and eleven people with severe mental illness participated in structured interviews at baseline, 9 months, and 18 months. RESULTS: The PGI captured a range of self-defined life areas. PGI scores were correlated with measures of QOL, hope, and functioning, indicating concurrent (criterion) validity. The correlation with QOL, with the finding that PGI scores were significantly higher for people who were employed (n = 42) versus unemployed (n = 269) and for people without substance use disorder (n = 269) versus those with substance use disorder (n = 42), is indicative of construct validity. CONCLUSIONS AND IMPLICATIONS FOR PRACTICE: The results support the suitability of the PGI as an idiographic measure for monitoring personalized QOL of people with severe mental illness. (PsycInfo Database Record (c) 2021 APA, all rights reserved).

Virtual health care for adult patients with intellectual and developmental disabilities: A scoping review.

BACKGROUND: The COVID-19 pandemic led to an abrupt shift to virtual health care for many patients, including adults with intellectual and developmental disabilities (IDD). Approaches to virtual care that are successful for people without IDD may need to be adapted for adults with IDD. OBJECTIVE: The aim of this scoping review was to examine what is known about virtual health care for adults with IDD and in particular, the impact of virtual delivery on access to care for this population. METHODS: A comprehensive search was conducted of the academic and grey literature. A two-stage screening process was conducted by two independent reviewers and a structured data extraction template was populated for each included study. Findings were analyzed thematically using Access to Care Framework domains. RESULTS: In total, 22 studies met inclusion criteria. The majority were published in the past three years and focused on specialized IDD services. A subset of 12 studies reported findings on access to care for adults with IDD. Participants generally reported high acceptability of virtual care, though some preferred face-to-face encounters. Initial results on effectiveness were positive, though limited by small sample sizes. Challenges included internet quality and technical skill or comfort. CONCLUSIONS: This review suggests that it is possible to deliver accessible, high quality virtual care for adults with IDD, however, relatively little research has been conducted on this topic. Due to COVID-19 there is currently a unique opportunity and urgency to learn when and for whom virtual care can be successful and how it can be supported.

Feasibility and acceptability of a volunteer peer fidelity assessment model in early psychosis intervention programmes in Ontario: Results from a pilot study.

AIM: Fidelity monitoring can support high-quality service delivery but is resource-intensive to implement. A fidelity assessment model utilizing volunteer assessors was trialled as a low-cost strategy for conducting fidelity assessments. This article reports on the acceptability and feasibility of this model. METHODS: Twenty volunteer assessors were trained to conduct fidelity assessments in nine Early Psychosis Intervention programmes across Ontario, Canada. Assessments were conducted using the First-Episode Psychosis Services Fidelity Scale based on a 2-day site visit, during which assessors interviewed staff, clients and families; reviewed charts; observed a team meeting and reviewed programme materials. The model was evaluated based on assessor focus groups, programme interviews, consensus meeting data and time-tracking logs. General inductive analysis was used to code and synthesize qualitative data. Quantitative data were aggregated and summarized. RESULTS: Participant feedback was positive and indicated that use of peer assessors and the in-person site visit added value to the process. The model was perceived to provide valuable information to support internal quality improvement efforts. Assessors reported direct benefits from participating, including networking and learning opportunities. Key challenges were the high time demand on assessors and turnover in the assessor team. CONCLUSIONS: The volunteer peer fidelity model was perceived to be a valuable improvement process by participants, but the high cost and reliance on ongoing volunteerism makes its sustainability uncertain. Next steps may include exploring remote assessment strategies or direct payments, although these strategies risk reducing the acceptability, and therefore uptake, of the assessment.

Early Psychosis Intervention-Spreading Evidence-based Treatment (EPI-SET): protocol for an effectiveness-implementation study of a structured model of care for psychosis in youth and emerging adults.

INTRODUCTION: While early psychosis intervention (EPI) has proliferated in recent years amid evidence of its effectiveness, programmes often struggle to deliver consistent, recovery-based care. NAVIGATE is a manualised model of EPI with demonstrated effectiveness consisting of four components: individualised medication management, individual resiliency training, supported employment and education and family education. We aim to implement NAVIGATE in geographically diverse EPI programmes in Ontario, Canada, evaluating implementation and its effect on fidelity to the EPI model, as well as individual-level outcomes (patient/family member-reported and interviewer-rated), system-level outcomes (captured in provincial administrative databases) and engagement of participants with lived experience. METHODS AND ANALYSIS: This is a multisite, non-randomised pragmatic hybrid effectiveness-implementation type III mixed methods study coordinated at the Centre for Addiction and Mental Health (CAMH) in Toronto. Implementation is supported by the Provincial System Support Program, a CAMH-based programme with provincial offices across Ontario, and Extension of Community Healthcare Outcomes Ontario Mental Health at CAMH and the University of Toronto. The primary outcome is fidelity to the EPI model as measured using the First Episode Psychosis Services-Fidelity Scale. Four hundred participants in the EPI programmes will be recruited and followed using both individual-level assessments and health administrative data for 2 years following NAVIGATE initiation. People with lived experience will be engaged in all aspects of the project, including through youth and family advisory committees. ETHICS AND DISSEMINATION: Research ethics board approval has been obtained from CAMH and institutions overseeing the local EPI programmes. Study findings will be reported in scientific journal articles and shared with key stakeholders including youth, family members, programme staff and policymakers. TRIAL REGISTRATION NUMBER: NCT03919760; Pre-results.

Emergency department nurses' knowledge, skills, and comfort related to caring for patients with intellectual disabilities.

INTRODUCTION: Individuals with intellectual disabilities (ID) are more likely to visit the emergency department (ED) more frequently than their counterparts without ID. Nurses play an integral role in caring for all patients in the ED, including those with ID, although training to work with this population is limited. The aim of this study was to examine the self-perceived knowledge, skills, and comfort of ED nurses when caring for a patient with ID. METHODS: Questionnaires were returned from 151 nurses from a total of six EDs within Ontario, Canada. The questionnaire contained fourteen items related to knowledge, comfort, practice and skills, readiness for change, prior exposure to patients with ID, and awareness of strategies to identify patients in this population. RESULTS: Although the majority of nurses reported an interaction with a patient with a suspected ID in the past year, only 28% of respondents reported awareness of strategies to help identify if a patient may have an ID, and only half reported feeling skilled in adapting their communication and approach. DISCUSSION: ED nurses are the first point of contact in caring for patients with ID, thus it is crucial that they understand how to provide accessible and inclusive care for this population.

Measurement without management: qualitative evaluation of a voluntary audit & feedback intervention for primary care teams.

BACKGROUND: The use of clinical performance feedback to support quality improvement (QI) activities is based on the sound rationale that measurement is necessary to improve quality of care. However, concerns persist about the reliability of this strategy, known as Audit and Feedback (A&F) to support QI. If successfully implemented, A&F should reflect an iterative, self-regulating QI process. Whether and how real-world A&F initiatives result in this type of feedback loop are scarcely reported. This study aimed to identify barriers or facilitators to implementation in a team-based primary care context. METHODS: Semi-structured interviews were conducted with key informants from team-based primary care practices in Ontario, Canada. At the time of data collection, practices could have received up to three iterations of the voluntary A&F initiative. Interviews explored whether, how, and why practices used the feedback to guide their QI activities. The Consolidated Framework for Implementation Research was used to code transcripts and the resulting frameworks were analyzed inductively to generate key themes. RESULTS: Twenty-five individuals representing 18 primary care teams participated in the study. Analysis of how the A&F intervention was used revealed that implementation reflected an incomplete feedback loop. Participation was facilitated by the reliance on an external resource to facilitate the practice audit. The frequency of feedback, concerns with data validity, the design of the feedback report, the resource requirements to participate, and the team relationship were all identified as barriers to implementation of A&F. CONCLUSIONS: The implementation of a real-world, voluntary A&F initiative did not lead to desired QI activities despite substantial investments in performance measurement. In small primary care teams, it may take long periods of time to develop capacity for QI and future evaluations may reveal shifts in the implementation state of the initiative. Findings from the present study demonstrate that the potential mechanism of action of A&F may be deceptively clear; in practice, moving from measurement to action can be complex.

Using Fidelity Measurement to Assess Quality of Early Psychosis Intervention Services in Ontario.

OBJECTIVES: The First Episode Psychosis Services Fidelity Scale (FEPS-FS) is a validated measure of program delivery in relation to international standards. This study assessed fidelity in Ontario programs and the utility of the FEPS-FS for program improvement. METHODS: Assessments were conducted in a volunteer sample of nine early psychosis intervention (EPI) programs. Thirty components of care were each rated on a 5-point scale; a rating of 4 indicates satisfactory performance. Trained assessor teams conducted site visits, and ratings were made by consensus. RESULTS: Program mean fidelity ratings ranged from 3.1 to 4.4 and exceeded 4 in five programs. Across the programs, item mean fidelity ratings ranged from 2.1 to 5 and exceeded 4 for 14 of 30 items. CONCLUSIONS: The FEPS-FS captured variation in program implementation and provided a baseline for measuring change. Additions to the scale are planned to address components of the Ontario EPI standards not covered by the FEPS-FS.